Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper

نویسندگان

  • Edward J Palmer
  • Peter G Devitt
چکیده

BACKGROUND Reliable and valid written tests of higher cognitive function are difficult to produce, particularly for the assessment of clinical problem solving. Modified Essay Questions (MEQs) are often used to assess these higher order abilities in preference to other forms of assessment, including multiple-choice questions (MCQs). MEQs often form a vital component of end-of-course assessments in higher education. It is not clear how effectively these questions assess higher order cognitive skills. This study was designed to assess the effectiveness of the MEQ to measure higher-order cognitive skills in an undergraduate institution. METHODS An analysis of multiple-choice questions and modified essay questions (MEQs) used for summative assessment in a clinical undergraduate curriculum was undertaken. A total of 50 MCQs and 139 stages of MEQs were examined, which came from three exams run over two years. The effectiveness of the questions was determined by two assessors and was defined by the questions ability to measure higher cognitive skills, as determined by a modification of Bloom's taxonomy, and its quality as determined by the presence of item writing flaws. RESULTS Over 50% of all of the MEQs tested factual recall. This was similar to the percentage of MCQs testing factual recall. The modified essay question failed in its role of consistently assessing higher cognitive skills whereas the MCQ frequently tested more than mere recall of knowledge. CONCLUSION Construction of MEQs, which will assess higher order cognitive skills cannot be assumed to be a simple task. Well-constructed MCQs should be considered a satisfactory replacement for MEQs if the MEQs cannot be designed to adequately test higher order skills. Such MCQs are capable of withstanding the intellectual and statistical scrutiny imposed by a high stakes exit examination.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Influence of Assessment Method Selection in Studying and Learning Approaches: Is It Necessary to Change Assessment Style?

Background: It is important to learn how to study for different examinations. The objective of the current study is to explore whether the assessment method selection would significantly affect the studying and learning approaches of students. Methods: This descriptive-analytical research consisted of 191 first-year undergraduate nursing students from three nursing schools and was conducted dur...

متن کامل

The Effect of Two Assessment Methods on Exam Preparation and Study Strategies: Multiple Choice and Essay Questions

Introduction: Utilizing appropriate approaches to study and learning can improve students’ academic performance. Recent studies have shown that students’ learning approaches are influenced by several factors including the type of assessment. The aim of this study is to assess the effect of multiple-choice tests (MCQ) and essay tests on the nursing students’ learning approaches. Methods: This q...

متن کامل

A Comparison of Students, Scores in Multiple- Choice and Essay Questions in Mother and Child Health Examination

  Background: The method of evaluation in students’ learning affects their studying mode. The aim of this study was to compare nursing students’ scores in essay and multiple-choice questions in Mother and Child Health examination in Shahrekord University of Medical Sciences. Methods: In this study, the  final scores of 121 of nursing students in a multiple-choice questionnaire consisting of 40 ...

متن کامل

Should essays and other “open-ended”-type questions retain a place in written summative assessment in clinical medicine?

BACKGROUND Written assessments fall into two classes: constructed-response or open-ended questions, such as the essay and a number of variants of the short-answer question, and selected-response or closed-ended questions; typically in the form of multiple-choice. It is widely believed that constructed response written questions test higher order cognitive processes in a manner that multiple-cho...

متن کامل

Analysis of Multiple Choice Questions Based On Classical Test Theory

Introduction: The aim of this study was to use Classical Test Theory (CTT) software for qualitative and quantitative analysis of Multiple Choice Questions (MCQ) for Master students of health discipline. Methods: This study was carried out on two groups each including 50 undergraduate students of public health, and two groups of 50 and 26 undergraduate students of occupational health. The final...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • BMC Medical Education

دوره 7  شماره 

صفحات  -

تاریخ انتشار 2007